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Abstract 

Objective. To investigate equity of patient outcomes in a psychological therapy service, following increased access achieved by a 
quality improvement (QI) initiative. 

Design. Retrospective service evaluation of health outcomes; data analysed by ANO\?\., chi-squared and Statistical Process 
Control. 

Setting. A psychological therapy service in Westminster, London, UK. 

Participants. People living in the Borough of Westminster, London, attending the service (from either healthcare professional or 
self-referral) between February 2009 and May 2012. 

Intervention(s). Social marketing interventions were used to increase referrals, including the promotion of the service through 
local media and through existing social networks. 

Main Outcome Measure(s). (i) Severitjr of depression on entry using Patient Health Questionnaire-9 (PHQ9). (ii) Changes to 
severitjr of depression following treatment (APHQ9). (ui) Changes in attainment of a meaningful improvement in condition 
assessed by a key performance indicator. 

Results. Patients from areas of high deprivation entered the service with more severe depression (M= 15.47, SD = 6.75), com- 
pared with patients from areas of low (M= 13.20, SD = 6.75) and medium (M= 14.44, SD = 6.64) deprivation. Patients in low, 
medium and high deprivation areas attained similar changes in depression score (APHQ9: M= —6.60, SD = 6.41). Similar pro- 
portions of patients achieved the key performance indicator across initiative phase and deprivation categories. 

Conclusions. QI methods improved access to mental health services; this paper finds no evidence for differences in clinical out- 
comes in patients, regardless of level of deprivation, interpreted as no evidence of inequitjr in the service with respect to this 
outcome. 
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Introduction 

In the UK, the Department of Health explicitly includes policy 
to reduce health inequalities within the National Health 
Service (NHS). Over the last 30 years much of the policy 
focus has been on the wider determinants of health but more 
recent efforts have included improving access to services [1]. 
National policy recognizes inequities in access lead to poorer 
clinical outcomes and exacerbate health inequalities; thus im- 
proving equal access on the basis of need should be a priorit}' 
[2]. Improving access to mental health services is an example 



where national policy has been developed to address inequities. 
The Improving Access to Psychological Therapies (lAPT) 
programme is based on evidence-based recommendations 
from the National Institute of Health and Clinical Excellence, 
proposing cognitive behavioural therapy (and additional spe- 
cific therapies) should be available for a range of common 
mental disorders (CMDs), including anxiet}' and depression 
[3—7]. The lAPT programme aims to improve access to treat- 
ment by providing an accessible community-based service tiiat 
improves clinical outcomes for patients, delivering a more 
equitable service [8]. 
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Specific barriers to improving access for 'seldom-heard 
groups' have been identified, recognizing that certain groups 
are less likely to access appropriate services, e.g. those with med- 
ically unexplained symptoms and people from black and minor- 
ity ethnic groups [9, 10]. Improving access to mental health 
services cannot be achieved by 'one-size-fits-all' approaches; the 
lAPT programme allows providers to develop locally relevant 
strategies aligned to the needs of local populations. 

Like many long-term conditions, CMDs are associated with 
deprivation [1 1], measured in the UK by the Index of Multiple 
Deprivation (IMD). Improving access to services is an import- 
ant step in delivering equitable services, and should be accom- 
panied by evidence of improvements in clinical outcomes. 

The Westminster lAPT Primary Care Psycholog}r Service 
was introduced in February 2009, and worked in partaership 
with the National Institute for Health Research (NIHR) 
Collaboration for Leadership in Applied Health Research and 
Care (CLAHRC) Northwest London, a quality improvement 
(QI) support programme, to increase referrals to the service 
between April 2010 and September 20 11. 

In the Westminster lAPT initiative, the QI approach facili- 
tated the distribution of social marketing materials to increase 
awareness of the service, accompanied by a staged introduc- 
tion of a self-referral route. The initiative aimed to increase 
referrals to the service, especially from people in deprived 
areas. A geospatial evaluation demonstrated that the strategy 
improved access to the service for patients from more 
deprived areas [12]. This paper builds on that analysis, asses- 
sing outcomes over time and across different categories of 
deprivation, as a measure of equit)'. 

Methods 

Quality improvement 

NIHR CLAHRC Northwest London was estabUshed in 2008 
as one of nine CLAHRCs in England, created to address the 
slow rate of implementation and spread of research findings in 
the NHS: the 'second translational gap' [13]. NIHR CLAHRC 
Northwest London assists clinical teams in the application of a 
comprehensive package of QI methods to support the sustain- 
able implementation of evidence-based interventions. 
A central method is the 'Model for Improvement' [14], provid- 
ing a framework to delivering an intervention and monitoring 
its successful uptake. 

Social marketing and self-referral interventions 

The Westminster lAPT worked to increase referrals to their 
service using QI methods, including weekly collection of refer- 
ral data and small-scale tests of change (Plan-Do-Study-Act 
cycles) to assess the phased delivery of social marketing inter- 
ventions including: 

• Distribution of leaflets and posters across public and 
communitjr venues throughout the borough. 

• Multi-media promotion of the service, including local 
radio, local newspapers and online. 



• Accessing social networks (e.g. communit)' groups, 
churches, societies and public and voluntary organiza- 
tions) to encourage referral. 

Data sources 

Routine demographic and clinical data from all patients re- 
ferred to the service were collected as per the minimum data 
set schedule using the lAPTus (Mayden, Wiltshire, UK) clinic- 
al data system [1 5] . Anonymized geocoded data were extracted 
for residents of the London borough of Westminster referred 
to the service during the period of analysis, February 2009 and 
May 2012, in line with a previous analysis [12]. The following 
data were extracted for each patient; square parentheses show 
correspondence to lAPT minimum data standard: 

• Lower Super Output Area (LSOA) [derived from person 
item 7]. 

• Date referral received [referral item 16]. 

• Date of initial assessment [derived from appointment 
item 25]. 

• Date of first therapeutic session [derived from appoint- 
ment item 25]. 

• Number of attended sessions [count of appointments]. 

• Reason for end of lAPT care pathway [referral item 23] . 

• Patient Health Questionnaire-9 (PHQ9) at first session 
[derived from appointment item 37]. 

• PHQ9 at last session [derived from appointment item 
37]. 

Inclusion criteria: 

• Patient referred to lAPT Westminster service between 28 
February 2009 and 21 May 2012. 

• LSOA of patients' residence falls within London 
Borough of Westminster boundary. 

Data processing 

Removal of duplicates from the extracted data based on post- 
code, date of initial assessment and reference number was per- 
formed. Data were aggregated into 'baseline', 'implementation' 
or 'sustainability' phases relating to the existence of the QI col- 
laborative tasked with improvement: 

• Baseline: service running prior to the establishment of 
the QI collaborative. Week 1 (February 2009) through to 
Week 58 (April 2010; 58 weeks). 

• Implementation: service running post-establishment of 
die QI coUaborative. Week 59 (April 2010) to Week 135 
(September 201 1, 77 weeks). 

• Sustainability: service running post-dis-establishment of 
the QI collaborative. Week 136 (September 2011) to 
Week 170 (May 2012, 35 weeks). 

To maintain confidentiality, the postcodes for each patient 
were assigned to corresponding LSOA [16] by the clinical 
team, using an online geospatial tool GeoConvert (http:// 
geoconvert.mimas.ac.uk). These governmental geographical 
regions are fine resolution and many UK statistics are 
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produced at this level, including IMD, enabling attribution of 
an estimate of socio-economic deprivation to eacii record; 
these were categorized by quintiles; quintile 1, low deprivation; 
quintUes 2—4, medium deprivation; quintile 5, high depriv- 
ation. 

Outcome measures 

The patient outcomes from the Westminster lAPT initiative at 
a population level are evaluated, using a measure of severitjr of 
depression (PHQ9), recorded as standard in the lAPT data 
set. A modified key performance indicator (KPI) [15, 17] — 
Move To Recovery (MTR) — based on PHQ9 scores is 
designed to evaluate attainment of a meaningful improvement 
in severity of depression. 

The outcome measures considered in this paper are 
designed to assess 

(1) the severity of depression on entry, those records with a 
recorded PHQ9; 

(2) changes to the sevetitjr of depression using APHQ9 
(the change in score between entry and exit to the 
service for those patients with a planned exit — agree- 
ment between patient and clinician); 

(3) changes in attainment of a meaningful improvement in 
condition, as measured by MTR. Here this is restricted 
to a measure solely concerned with the depression 
scores on entry and exit (MTRDEP). To achieve 
MTRDEI^ PHQ9 on entry to die lAPT service must 
be equal to or higher than 10 and less than 10 on a 
planned exit from the service, with 10 indicative of 
'caseness' — the patient is considered to have at least 
rmld severity depression. 

Analysis 

Analysis of seventy of depression on entry 

Two-way ANO\A compares the mean PHQ9 on entry for 
patients from low, medium and high levels of deprivation 
during the baseline, implementation and sustainabUity phases 
of the QI initiative. The normality and homoscedasticity 
assumptions of ANO\Awere tested. 

Analysis of change in depression score between 
entry and exit 

Two-way ANO\A compares the mean APHQ9 for patients 
from low, medium and high levels of deprivation during the 
baseline, implementation and sustainability phases of the Ql 
initiative. The normality and homoscedasticity assumptions of 
ANO\Awere tested. 

Analysis of effectiveness of a KPI to demonstrate 
clinical outcome 

Statistical process control (SPC, see Box 1) was used to assess 
whether there were changes in the proportion of patients attain- 
ing MTRDEP In this case, a p-chart is used, since the measure 



is a proportion of patients satisfying certain criteria and the de- 
nominator is not constant from month to month [18]. 



Three chi-squared tests, one for each initiative phase, were 
used to examine for effect of IMD category on the numbers 
attaining MTRDEP In each case, the nuU hypothesis states 
that the proportion of patients achieving MTR does not differ 
across categories of deprivation. 



Results 

During the period of analysis, February 2009 to May 2012, 
6062 patients were referred to the lAPT service. During the 
baseUne phase. Weeks 1-58 (February 2009 to March 2010), 
before the start of the QI initiative, 992 referrals were made 
with a mean referral of 17.02 (SD = 14.44) patients per week; 
the implementation phase. Weeks 59-135 (April 2010 to 
September 2011), saw 3295 patients referred with an mean re- 
ferral of 42.69 (SD = 12.46) patients per week; finally the sus- 
tainabiHt>' phase. Weeks 136-170 (October 2011 to May 2012) 
saw a total of 1791 patients referred with a mean weekly refer- 
ral of 51.09 (SD = 13.13) patients per week. A one-way 
ANO\A determines a significant difference in the means of 



Box I Key notes for SPC 

• SPC was developed by Shewhart in the 1920s [18] as a 
statistical methodology for detecting changes in time- 
series data through quantification of the natural variation 
exhibited in any system, without explicit knowledge of 
the underlying distribution [23, 24]. Its use in healthcare 
has increased over the last 20 years and can be useful in 
managing change [25]. 

• SPC is an appropriate and flexible analysis of time-series 
data, assessing for changes in process. 

• SPC uses a varietjr of control charts depending on the 
situation, all of which plot the data, a measure of central 
tendency (often the mean) and two 3-sigma control 
limits demarking the expected variation of the system. 
These are tjrpically displayed as four lines — one showing 
the data, one a solid Une of central tendency and two 
dashed control limits. 

• These features are used to diagnose properties of the 
system, using well-established rules to determine 
whether the system is stable including [23] 

o a point lying outside either of the control limits; 

o a run of seven consecutive points all above or all 
below the central line; 

o a run of seven consecutive points all increase or all de- 
crease. 

• If a 'rule break' has occurred, the system is not stable 
and is changing — it is 'out of control'. 

• This 'out-of-control' state is desired, at least in the short 
term, if one is trying to alter the system into a new mode 
of operation, i.e. improve from a stable underperforming 
system to a better performing one. 
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referrals between the periods (F(2167) = 91.254, P< 0.001). 
A Tukey post hoc test revealed that mean referrals in the baseline 
(M= 17.02, SD = 14.44) were significantly lower than for im- 
plementation (M= 42.69, SD = 12.46, P< 0.001) and sustain- 
ability (M= 51.09, SD = 13.13, P< 0.001) phases, which 
themselves were statistically different (P = 0.006). 

Patients included were referred from 120 unique LSOAs. 
Of the 6062, 3864 (64%) patients had a PHQ9 recorded for 
first assessment; 1599/6062 (26%) had a planned exit from 
the service (agreement between patient and clinician). 

Both first and last PHQ9 scores were recorded for 1426/ 
6062 (24"/o), enabling the calculation of APHQ9. First PHQ9 
scores of >10 — 'caseness' — ^were found for 1003/1426 
(70%), of whom 662/1003 (66%) achieved MTRDEP The 
percentages of patients not informed of other services or had 
an unplanned or exit (i.e. 'dropping-out') were 450/987 (46%) 
in the baseline phase, 1552/3287 (47%) in the implementa- 
tion phase and 1206/1788 (67%) in the sustainabUit)' phase. 
A higher rate of dropout was observed in the high deprivation 
areas (841/1428, 59%) compared with the low deprivation 
(459/955, 48%) and medium deprivation (1908/3679, 52%) 
areas. Chi-squared tests of these proportions find statistically 
significant differences in drop-out rates with regard to period 
(2, N= 6062) =215.69, P< 0.001] and IMD category 
(2,iV= 6062) = 31.14, P< 0.001]. 



Analysis of seventy of depression on entry 

Two-way ANO\A finds deprivation, as measured by IMD 
category (F(2,3855) = 15.06, P= 0.004), and initiative phase 
(F(2,3855) = 5.58, P< 0.001) have a statisticaUy significant 
impact on the PHQ9 on entry to the service, but the inter- 
action between these variables is not significant (F(4,3855) = 
0.77, P = 0.54). The average values are plotted in Fig. 1: 
patients from high IMD areas (i.e. high deprivation areas) 
attend the service with a higher PHQ9 score {hi — 15.47, SD 



— 6.75) indicative of a more severe level of depression, com- 
pared with low (M= 13.20, SD = 6.75) and medium (A^ = 
14.44, SD = 6.64) IMD areas. Tukey post hoc tests reveal signifi- 
cant differences between low and medium (P < 0.001); low and 
high (P < 0.001) and medium and high (P < 0.001) pairings. 
The mean PHQ9 on entry in both the implementation phase 
(M= 14.61, SD = 6.71) and the sustainabUity phase (M= 14.71, 
SD = 6.63) is higher than that in the baseline phase (M= 13.72, 
SD = 6.83). Tukey post hoc tests reveal significant differences 
between baseline and implementation (P = 0.005) and baseline 
and sustainability (P = 0.007) pairings, but no difference for 
implementation and sustainability (P = 0.921). 

Analysis of change in depression score between 
entry and exit 

Two-way ANO\A finds no significant effect of IMD category 
(F(2,1417) = 0.90, P = 0.406), initiative phase (F(2,1417) = 
0.11, P = 0.894) or the interaction term (F(4,1417) = 0.77, 
P = 0.543) on the average APHQ9. The average values are 
plotted in Fig. 2. The nuU hypothesis of no difference between 
the average values as classified by the initiative phase and IMD 
cannot be rejected. 

This result finds no evidence that the initiative phase (and 
thus intensity of referrals, as more referrals occurred in the im- 
plementation and sustainabiUt}' phases) and deprivation affect 
the benefit that patients received from the service (APHQ9: 
M— —6.60, SD = 6.41). However, Fig. 2 shows some differ- 
ences in patterns comparing the sustainability phase with the 
other phases. 

Analysis of effectiveness of a KPI to demonstrate 
clinical outcome 

SPC analysis does not detect any 'rule breaks' (see Box 1) for 
changes in process in the proportion of patients attaining 
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Figure I The average PHQ9 on entry for patients. A higher 
value represents a greater severity of depression. This figure 
shows that both IMD and initiative phase impact the average 
PHQ9 score at entry. 95% confidence intervals are plotted. 



O -4,00 

o 
l» 
o> 
O 
X 

a. 

C -6.00 



2. -8.00 
IB 



Baseline 



Implementation Sustainability 



Low Medium High 



Low Medium High 
IMD 



Low MedkJm High 



Figure 2 The average APHQ9 for patients with planned exit. 
A negative value represents an improvement. This figure 
shows that both IMD and initiative phase do not affect the 
average APHQ9 score. 95% confidence intervals are plotted. 
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Figure 3 A p-chart showing the proportion attaining MTRDEP, at monthly frequency and with variable width limits of expected 
variation, accounting for differing denominators. No rule breaks were observed. The process is considered to be in statistical 
control. 



MTRDEP (Fig. 3), implying a stable process. Thus, 66% of 
these exits are expected to achieve MTRDEP on average, im- 
pljring that regardless of intensitjr of referral there is 
no evidence in the data for service inequity by deprivation cat- 
egory. 

None of the chi-squared tests of interaction can reject the 
null hypothesis of no association between project period and 
the proportions attaining MTRDEP in each IMD category 
[baseline: (2, N = 209) = 1.91, P= 0.38; implementation: 

(2, N = 676) = 1 .61, P = 0.44; sustainability: %^{2,N=n 8) 
= 3.74, P = 0.15)]. Thus, during each initiative phase there is no 
evidence for inequity of outcome in this measure. 



Discussion 

During the implementation phase, the average weekly referral 
rate increased compared with the baseUne phase; which was 
subsequentiy sustained. It is difficult to associate any specific 
component of the intervention with increases in referrals due 
to the concurrent delivery of several components; yet taken as 
a whole, the combined intervention demonstrated an increase 
in referral. 



A previous geospatial evaluation demonstrated that a strat- 
egy to improve access to the Westminster lAPT service 
increased access for all patients, especially from more deprived 
areas with associated higher healthcare needs. [9] This analysis 
of the same cohort of patients finds no evidence for 
non-equivalence of cUnical outcomes between areas of differ- 
ing levels of deprivation. 

Patients entering the service from areas of higher depriv- 
ation have a higher average PHQ9 score; this gives credence to 
an underlying assumption that the severity of CMDs, specifically 
depression, is positively associated with IMD score, which acts 
as a proxy for need. In addition, the initiative phase seems to be 
important, with the people accessing the service having higher 
PHQ9 scores on average during the implementation and sus- 
tainability phases than in the baseline phase, and there was no 
overall tendency for the service to be accepting referrals from 
the 'worried well'. Whilst differences in PHQ9 scores exist for 
entrjr the clinical meaningfukiess of this is doubtful. 

No evidence for inequitjr of outcome between areas of dif- 
fering levels of deprivation is observed in these data between 
the phases. Therefore, even with increased access to the 
service because of the QI initiative, there is no evidence that 
the prescribed course of therapies benefited patients from all 
deprivation categories differentially. 
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The analysis of MTRDEP, demonstrating meaningful 
changes in depression, found no difference between patients 
living in areas of low, medium and high deprivation or with the 
phases of the QI initiative. Whilst there are more dropouts in 
the sustainabUit}' phase, the QI initiative aimed only to increase 
access; this finding highlights a novel issue that those people 
now encouraged to join might be less likely to be retained. 
Analysis of the point at which dropout occurs over the pre- 
scribed course of treatment could be considered, and used to 
aid retention. 

In Europe, the odds of people from more disadvantaged 
backgrounds (i.e. low educational attainment, low income and 
lower occupational status) suffering from CMDs have been 
estimated to be 1.5—2 times the rest of the population [11]. 
There can be significant levels of unmet mental health need in 
communities, especially in inner cities, where demographics 
and social factors affect consultation and health-seeking be- 
haviour [10], requiring health policies and initiatives need to 
tackle these inequalities at both local and national levels. 

Overall, 66% of patients with planned exits 'moved to re- 
covery', across time and categories of deprivation. Whilst 
some patients did not achieve a 'meaningful clinical outcome' 
(as defined by the KPI), they may stiU benefit from access to 
the service, as mental health is often linked to other long-term 
needs. Physical and mental health has a complex relationship, 
and so providing care to those with long-term needs can have 
other benefits not captured by PHQ9 metrics. 

This analysis provides knowledge of a healthcare system at a 
population level and highlights the use of routine data in pro- 
viding decision support and service evaluation. The import- 
ance of using data that are currently available and pertinent to 
the service should not be overlooked: they provide an opportun- 
ity to evaluate with minimal burden to service staff and generate 
outputs with metrics familiar to providers and commissioners 
alike [19]. This is particularly beneficial where metrics are avail- 
able at high temporal and geographical resolutions, allowing pro- 
cesses and outcomes of care to be monitored. 

Limitations of this study 

The outcomes for those living within areas of low, medium 
and high deprivation have no evidence of inequity, but there is 
heterogeneity in outcome at a patient level: within each group, 
some patients are responding more to treatment. A patient 
level model encompassing demographics and finer scale pre- 
dictors would be required to investigate this heterogeneitjr. The 
anxiety component of an MTR metric was not considered: the 
measure of anxiety (GAD 7) has not yet had its responsiveness 
over time direcdy evidenced as a primary measure in longitu- 
dinal studies [20]. Hence, the depression metric (PHQ9), 
which has been so evidenced, was used [21]. A single self- 
report measure (PHQ9) may not capture the fuU complexity 
of each case, but as the prescribed therapies have been evi- 
dence to affect this measure direcdy [4, 6, 21] and it is the 
recorded clinical outcome, this analysis focuses on the depres- 
sion score. 

Whilst a previous geographic analysis showed improved 
equity of access [12], and here no evidence of differences in 



outcomes is found (at a population level) for those completing 
the prescribed course of therapies, there are differences in the 
proportions dropping out of the service from high, medium 
and low deprivation areas. Research into factors affecting 
dropout at a patient level would be useful to examine for any 
differential exits. Finally, this analysis examines the outcomes 
of all referral tjrpes, as there is a difficulty in separating self- 
referrals from GP initiated self-referrals, because the lAPT 
data standard does not hold this information. 

Conclusion 

This analysis found no evidence of differing clinical outcomes 
for patients in a local lAPT service from areas of different 
levels of deprivation. At a population level, throughout time, 
no evidence was found for influences of increased input. 
To explore factors that may influence clinical outcome, a 
patient level analysis with socio-demographic variables in a 
predictive model would be helpful to elucidate any heterogen- 
eitjr masked at a population level. 

The UK's Department of Health holds a vision of a 
patient-led healthcare system that delivers better health out- 
comes, with local autonomy and accountability. QI provides a 
methodology to ensure service providers are responsive to the 
needs of local populations for the delivery of equitable care. 
Aligning QI to population health can help to demonstrate how 
service improvements have affected the population as a whole, 
or to identify priorities for improvement [22] . 
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